Journal of Cognitive Neuroscience

Many cognitive processes depend on integrating information as it becomes available to construct meaningful interpretations. Prior work has shown graded and incremental context effects, especially in language, but it remains less clear whether contextual integration exhibits a comparable temporal profile across symbolic domains when structured input is examined within congruent sequences. Twenty-seven participants processed congruent four-element sequences designed to be structurally comparable across lexical, algebraic, and graphical domains while event-related potentials were recorded. In the 250-500 ms interval, mean amplitudes increased systematically with sequence position within a predefined centro-parietal region of interest (p < .001). The Domain x Position interaction did not reach significance (p = .056), although modest domain-related differences in the buildup profile cannot be ruled out. A follow-up analysis showed that the increase to the response-relevant final position was larger than earlier increases (p < .001). Additional analyses indicated maximal amplitudes over parietal sites and the clearest graded increase over central sites. These findings indicate that context-sensitive activity was progressive but not uniform across sequence positions, with the strongest increase occurring when the sequence reached its final, response-relevant completion point. The presence of position-related increases across lexical, algebraic, and graphical domains is consistent with the view that centro-parietal ERP activity in the 250-500 ms window tracks the progressive buildup of contextual integration during structured sequence processing. HighlightsO_LIContext-sensitive ERP activity increased across sequence position. C_LIO_LIThe strongest increase occurred at the final completion point. C_LIO_LIMaximal amplitudes were observed over parietal electrodes. C_LIO_LICentral sites best captured graded position-related modulation. C_LIO_LIPosition-related buildup was observed across symbolic domains. C_LI

Past work has indicated that expectation can modulate neural responses to visual stimuli, but it is unclear whether these effects remain consistent across different types of unexpected stimuli. Here, we measured and compared neural prediction effects associated with semantic category and presentation frequency-based expectations in real-world object stimuli. Participants (n = 35) viewed real-world object images in rapid serial visual presentation (RSVP) streams. Semantically unexpected stimuli occurred when a stimulus was presented in a semantically incongruent stream. Low-frequency violations occurred when a rarely presented stimulus was displayed in a semantically congruent stream. Multivariate pattern analysis of electroencephalography (EEG) was used to quantify and compare the degree of information represented in neural activity for stimuli in different prediction conditions. Semantically expected stimuli yielded lower decoding accuracy relative to random (unpredictable) stimuli (125-313 ms post-onset) while semantically unexpected stimuli exhibited increased decoding accuracy (199-238 ms & 523-559 ms). Low-frequency violations yielded decoding accuracy which was not significantly different from semantically expected stimuli. Exploratory analyses indicated that dissimilarity between expected and presented stimuli quantified in terms of higher-level stimulus features, but not low-level visual features, modulated the observed neural prediction effects. These results demonstrate that different types of prediction violations have distinct modulatory effects on neural responses, providing novel insight into the neural implementation of predictive processing.

Selective attention enables the prioritization of task-relevant information while managing distractors, and steady-state visual evoked potentials (SSVEPs) are widely used to track this process by tagging different visual objects at distinct flicker frequencies. However, whether the choice of tagging frequency itself influences other neural and cognitive measures remains unclear. Here, 27 participants performed detection and 1-back working memory tasks while a central target and peripheral distractors flickered at either 8.6 Hz or 12 Hz. The working memory task produced slower responses, more errors, and greater perceived difficulty than detection. Tagging frequency strongly shaped neural responses, with 8.6 Hz eliciting higher SSVEP signal-to-noise ratios than 12 Hz regardless of stimulus location. Nevertheless, stronger SSVEP responses for centrally attended stimuli were associated with fewer working memory errors and larger early visual ERP responses, while SSVEPs for attended and distractor stimuli were negatively correlated. In addition, the working memory task produced a larger P1-N1 peak-to-peak difference, and tagging frequency altered the timing and amplitude of early ERP effects. Together, these findings show that tagging frequency is not a neutral methodological parameter, but one that shapes both neural indices of attention and their relationship to cognitive performance.

Saccades made during memory maintenance prioritize memory for the saccade target, but it is unclear if this benefit is specific to a location or extends across memorized objects. In three experiments, we examined whether saccadic selection spreads to other locations within the same object. In Experiment 1, we asked observers to remember three oriented Gabors presented either within contour-defined objects or without object structure. A subsequent movement cue prompted observers to move their eyes to the indicated location. We then probed memory for stimuli at locations equidistant from the saccade target, in either the same or a different object. Memory was best for stimuli at locations congruent with the saccade target, and consistently weaker for other stimuli presented in the same or a different object than the saccade target. In Experiment 2, we created more complex objects by adding more object features to the stimulus. Again, memory performance was best for stimuli congruent with the saccade target location, whereas memory in incongruent trials was worse and similar for stimuli in the same and different object as the saccade target. In Experiment 3, we tested if saccadic selection is present and propagates within the object in a change detection task. Again, memory performance (i.e., change detection) was best at the saccade target location. However, this memory benefit also spread to other locations within the same object. Our results imply that saccadic selection in visual working memory is primarily space-based but can also spread towards locations within the object where a saccade was directed.

When humans learn under conditions of uncertainty, they dynamically adjust how they prepare for and respond to feedback. In navigating uncertain environments, the brain minimizes error by continuously refining internal models via memory updating (MU). Feedback is critical for MU, and anticipatory neural mechanisms shape how feedback is processed, likely reflecting learned environmental certainty. However, the literature has largely focused on post-feedback activity, leaving pre-feedback certainty-related mechanisms less understood. The present study aims to address this gap by examining how certainty modulates anticipatory states, preceding feedback and subsequent MU. We examined oscillatory activity prior to performance feedback in a reanalysis of EEG data previously published by Hassall and colleagues (2023). Twenty-one participants (16 female, Mage = 25.81 years) predicted the strength of cartoon characters with varying predictability levels which were learned through exposure. Feedback on prediction accuracy was presented via an animated rising bar. Results revealed that theta power is modulated by accumulative feedback. Linear mixed-effects models revealed an interaction between predictability-related certainty and learning stage: in late learning, higher performance was associated with increased pre-feedback alpha and beta power for low-certainty trials, whereas in early learning, higher performance was associated with decreased beta power. These learning-related modulations in alpha and beta power suggest that initial learning is marked by adaptable exploratory processing. Subsequent learning exhibited increased alpha-mediated inhibition and beta-related anticipatory activity for lower certainty trials, indicative of dynamic strategy refinement and selective engagement of task-relevant information. These results demonstrate that certainty shapes preparatory oscillatory activity associated with MU.

A recent theoretical model of action stopping posits that the reactive cancellation of movement is underpinned by two dissociable processes: a rapid, involuntary "pause" that transiently suppresses motor output, and a slower, voluntary, suppression/retuning of motor output. Notably, the pause process has been posited to generalise broadly to infrequent and salient stimuli (irrespective of whether they bear an imperative to stop) and to be observable as suppression in electromyographical (EMG) recordings in the responding muscles. Over two experiments (N = 24 in each), participants completed standard stop signal and flanker tasks, and novel flanker task variants, where flanking arrows occurred infrequently (33% of trials), with or without a delay relative to the central imperative stimulus, or coincident with a stop signal. Presenting flankers infrequently specifically increased slowing to incongruent trials, with no effect on congruent or neutral trials (relative to a condition with flankers on every trial), and only after at least three preceding trials with no flanking stimuli. Critically, this was observed while carefully controlling for trial sequence effects. When flanker stimuli were presented infrequently, and after a delay, they did not reliably elicit suppression of EMG. These results highlight the contextual specificity with salient infrequent stimuli elicit behavioural slowing and EMG suppression, challenging the notion of a broadly generalisable pause process. Trial-level assessment of stopping speed using EMG revealed an effect of stimulus salience, whereby stop signals that occurred synchronously with Flanker arrows resulted in faster stopping than stop signals without Flanker arrows. Interestingly, this effect was specific to the faster end of stopping time distributions. Collectively, these results challenge interpretations which attribute electromyographic partial responses to specific neural pathways or mechanisms.

Decisions based on evidence accumulated over time require rules governing when to end the accumulation process and commit to a choice. These rules control inherent trade-offs between decision speed and accuracy, which require careful balance to maximize quantities that depend on both like reward rate. We previously showed that, to maximize reward rate, normative decision rules adapt to changing task conditions (Barendregt et al., 2022). Here we used a novel task to examine whether and how people use adaptive rules for individual decisions under a variety of conditions, including changes in decision outcomes across trials and changes in evidence quality both across and within trials. We found that the participants tended to use rules that adjusted, at least partially, to predictable changes in task conditions to improve reward rate, consistent with a rationally bounded implementation of normative principles. These findings help inform our understanding of the extent and limits of flexible decision formation in the brain.

People often switch tasks when attention wanes or an alternative task becomes more appealing. Such choices may reflect different control modes that may vary with working memory (WM) capacity. This study tested whether momentary attentional lapses prospectively predict voluntarily task switching and whether this relationship depends on WM capacity. Participants performed a continuous performance task involving face and scene images, with blocks in which they either freely chose the next task or followed an externally imposed sequence. A clear capacity-dependent crossover emerged where individuals with lower capacity were more likely to switch following lapse-prone blocks, whereas higher-capacity individuals tended to switch from relatively well-focused states. Eye-tracking revealed greater bias toward the competing irrelevant category before switches in lower-capacity individuals, accompanied by early conflict-related pupil dilation. Externally imposed task sequencing selectively reduced lapses in the lower-capacity group without affecting higher-capacity performance, suggesting that external structure can scaffold weaker internal goal maintenance. These findings suggest that the relationship between lapses and voluntary switching varies with WM capacity rather than being uniform across individuals. This pattern is consistent with a goal-competition account in which lapses reflect shifts in the balance between competing task goals, and voluntary switches may be preceded by different control states.

Spatialization in working memory refers to the spatial coding of non-spatial information along a mental horizontal line when encoding verbal material. This phenomenon is thought to support working memory by facilitating order encoding. Although it has been observed for both visually and auditorily presented stimuli, no direct comparison has yet examined whether these modalities rely on similar neural mechanisms. In this study, we investigated whether spatialization in visual and auditory modalities involves shared or distinct patterns of activity within the working-memory network. Forty-nine participants performed both a visual and an auditory working memory SPoARC task of the same verbal material, allowing to study the cortical patterns associated with distinct serial positions at both encoding and recognition across sensory modalities. Whole-brain analyses revealed similar frontoparietal networks across conditions. In addition, a representational similarity analysis (RSA) was conducted to assess the similarity of neural patterns between early and late serial positions in a sequence and across sensory modalities. This multivoxel pattern analysis revealed modality-dependent patterns distinguishing early and late positions in the inferior frontal gyrus. Additional modality-specific effects were observed in the anterior intraparietal sulcus in the visual modality and in the posterior hippocampus in the auditory modality. Drawing on the framework proposed by Bottini & Doeller (2020), we propose that order decoding in the IPS might reflect a low-dimensional spatial coding of order (e.g., along a horizontal axis), whereas order decoding in the hippocampus might reflect higher-dimensional spatial representations or temporal representations.

The extent to which attention and memory processes rely on shared as opposed to distinct mechanisms is critical for understanding the role of both processes in cognition. As working memory sits at the intersection of external, perceptual input and long-term internal storage, it provides the ideal testbed for investigating overlaps between attention and memory. We hypothesize that memory brain states, whole-brain activity patterns that support long-term memory encoding and retrieval, map onto the external/internal axis of attention. Specifically, we hypothesize that external attention, focusing on sensory information, recruits the encoding state and internal attention, focusing on stored information, recruits the retrieval state. To test this hypothesis, we conducted a scalp electroencephalography study in which participants engaged in a working memory paradigm with and without maintenance demands. We used an independently validated cross-study multivariate pattern classifier to measure memory brain state engagement during change and target detection tasks. We find that the encoding state is recruited for stimulus presentation during both tasks, whereas the retrieval state is selectively recruited during the delay of the change detection task. Together, these results suggest that memory states map onto the external/internal axis of attention to support working memory, long-term memory, and cognition more broadly.

It is critical to identify which factors induce specific brain states as these large-scale patterns of coordinated neural activity drive downstream processing and behavior. The retrieval state, a brain state engaged when attempting to retrieve the past, is thought to specifically support episodic memory, remembering experiences within a spatiotemporal context, as opposed to semantic memory, remembering general knowledge. However, we hypothesize that the retrieval state reflects internal attention engaged to access stored episodic and semantic information. To test these alternatives, we recorded scalp electroencephalography while participants made episodic, semantic, or perceptual judgments, and applied an independently validated mnemonic state classifier to measure retrieval state engagement. We found that retrieval state engagement was greater for both episodic and semantic judgments compared to perceptual judgments. These findings suggest that the retrieval state reflects a domain-general internal attention process that supports not just episodic memory, but internally directed cognition.

Listeners face many challenges when trying to maintain attention to a target source in everyday settings; for instance, reverberation distorts acoustic cues and interruptions capture attention. However, little is known about how these challenges affect the ability to maintain selective attention. Here, we measured syllable recall accuracy and pupil dilation during a spatial selective attention task that was sometimes disrupted. Participants heard two competing, temporally interleaved syllable streams presented in pseudo-anechoic or reverberant environments. On randomly selected trials, a sudden interruption occurred mid-sequence. Compared to anechoic trials, reverberant performance was worse overall, and the interrupter disrupted performance. In uninterrupted trials, reverberation reduced peak pupil dilation both when it was consistent across all stimuli in a block and when it was randomized trial to trial, suggesting temporal smearing reduced clarity of the scene and the salience of events in the ongoing streams. Pupil dilations in response to interruptions indicated perceptual salience was strong across reverberant and anechoic conditions. Specifically, baseline pupil size before trials did not vary across room conditions, and mixing or blocking of trials (altering stimulus expectations) had no impact on pupillary responses. Together, these findings highlight that stimulus salience drives cognitive load more strongly than does task performance.

Multitasking is generally regarded as detrimental to performance. This deterioration effect is typically explained by the interference among tasks due to the limited capacity of information-processing resources, which in turn reduces the performance in each task. Contrary to this general view, we report evidence for a facilitation effect of multitasking on performance. This facilitation effect was observed in multitasking on a handgrip muscular endurance task and cognitive task, which are known to have little interference with each other. Specifically, we found that performance in the endurance task was facilitated with the difficulty of the concurrent cognitive task. This facilitation effect was mediated by additional pupil dilation due to the cognitive task. Increased effort with the difficulty of the cognitive task cannot explain the facilitated performance in the irrelevant endurance task. Instead, they suggest that the cognitive task elevated overall arousal to a level unattainable by the endurance task alone, which in turn facilitated performance in the irrelevant endurance task. To further test this arousal account, we manipulated participants motivation to the cognitive task by reward without changing its difficulty and found the same pattern of results. Thus, it is not effort or motivation specific to the cognitive task but rather overall arousal level that underlies the facilitation effect. These results unveiled a previously overlooked mechanism: a multitasking-induced arousal boost. Our findings suggest that multitasking can facilitate performance when the net effect of adding a concurrent task is governed less by the capacity limitation and more by the elevation of overall arousal.

Reaction time is a measure of the speed of our response to stimuli in the environment. Even for a well-trained task, a subjects reaction time varies. One source of this variability is internal state fluctuations (such as changes in arousal). There are few studies that systematically quantify the extent to which reaction time varies across different timescales and link this to measures of systemic physiology associated with arousal. In much of the literature, it is assumed but not demonstrated that behavioral and systemic measurements associated with arousal will be consistently linked because both estimate a common underlying arousal process. In this work, we examined this assumption by simultaneously measuring reaction time, heart rate, and pupil diameter in rhesus macaque monkeys performing several visual tasks over hours and across hundreds of sessions. We found a portion of the variability in reaction time could be linked to systemic physiological signatures of arousal on fast timescales from second to second and slower timescales from minute to minute. This link between reaction time and systemic physiology was also present for different biomarkers of arousal (heart rate and pupil). However, the strength of this relationship varied depending on the arousal biomarker. Our findings support the conclusion that there are multiple arousal mechanisms that act simultaneously to influence behavior and multiple timescales at which they operate.

Human behavior is highly flexible, allowing efficient performance across a wide range of task contexts. A distributed set of frontal and parietal regions, commonly termed the multiple-demand network (MDN), is consistently engaged during diverse cognitively demanding tasks and is thought to support this flexibility. However, it remains unclear how patterns of MDN engagement relate to the qualitative features of ongoing cognition experienced during task performance. To address this issue, we examined the reliability of self-reported experiential features sampled during performance of a broad range of tasks. Across tasks, we found little evidence that particular patterns of thought were intrinsically more reliable than others, nor that individual tasks were associated with stable, characteristic thought profiles. Instead, the reliability of specific experiential features varied systematically across task contexts, with the same patterns showing high stability in some tasks and low stability in others. We next asked whether stable patterns of thought were associated with distinct neural signatures. We found that patterns of brain activity resembling the MDN tended to be present for tasks in which deliberate task focus was high, and when distraction was lower, adding to an emerging body of research suggesting that coordinated activity within frontal and parietal regions helps to establish a stable goal-focused mode of thoughts and actions.

Historically, neural variability observed during task was interpreted as "noise," assumed to obscure meaningful signal and thus something to be minimized both analytically by researchers and functionally by the brain. Changes to this signal-to-noise ratio have been proposed as a possible neural mechanism behind the increased reaction-time variability (RTV) in attention deficit hyperactivity disorder (ADHD). However, not all variability is the same - in some cases, variability can have some underlying "statistical structure" that can be beneficial to information processing. The challenge lies in distinguishing meaningful variability from random noise. The edge-of-synchrony critical point, which describes a system poised between synchronous and asynchronous regimes, could be a good theoretical framework to study these different types of neural variability. In this study, we investigate whether changes in criticality and oscillatory dynamics preceded slower behavioral responses during a bimodal continuous performance task in ADHD. We find evidence that, prior to slower responses, neural dynamics shift toward criticality in both ADHD and control groups, suggesting that increase variability in ADHD and during attention lapses are related to structured variability and not necessarily random noise. Notably, these findings run counter predictions based on the proposed model and previous literature on neural noise in this population, challenging predictions of edge-of-synchrony criticality as a unifying account of neural variability and behavioral performance. Furthermore, this effect did not emerge at the between-subject level, underscoring the limitations of relying on between-subject correlations to infer neural mechanisms. Impact StatementOur findings add new perspective to the hypothesis that links neural variability to reaction time variability in adults with and without ADHD. We found that neural dynamics shift towards criticality prior to slow reaction times in adults with and without ADHD, but in ADHD, dynamics lie closer to criticality regardless of response type, suggesting a different "attractor" state.

Verbal fluency is a behavioral task that requires the generation of words from a semantic category (category fluency) or words beginning with a specific letter (letter fluency). Although word production engages a frontal-temporal-parietal network, no studies have tested how lesions to temporal and parietal lobe areas that represent semantic and phonological knowledge dampen neural responses in the left pars triangularis and the left pars opercularis, two adjacent regions in the left inferior frontal gyrus implicated in word search and retrieval. Here, 52 patients with temporal lobe lesions underwent clinical functional MRI while performing the category and letter fluency tasks. We investigated where lesion presence was inversely related to the magnitude of task-specific neural responses in pars triangularis and pars opercularis using a technique referred to as voxel-based lesion activity mapping (VLAM). We found that lesions to the left anterior superior temporal gyrus, left temporal pole, left hippocampus, left insula, and underlying inferior fronto-occipital fasciculus were associated with reduced neural responses in the left pars triangularis during the category fluency task. Lesion damage to the right hippocampus was associated with reduced neural responses in the left pars opercularis during category fluency. By contrast, lesions to the left posterior superior temporal gyrus, left supramarginal gyrus, left parietal operculum, and the inferior fronto-occipital fasciculus and left arcuate fasciculus were associated with reduced neural responses in the left pars triangularis and the left pars opercularis during the letter fluency task. These results suggest that anatomically dissociable brain networks interact with the left inferior frontal gyrus when different search strategies constrain the retrieval of word representations.

People frequently gesture while speaking, even when listeners cannot see them--for instance, during phone calls or behind barriers. Congenitally blind individuals also gesture, indicating that gestures serve functions beyond visual communication. Previous models of gesture production (e.g., Kita & Ozyurek, 2003; Rauscher et al., 1996) suggest that gestures facilitate speech, but they rely heavily on behavioural data and provide limited insight into temporal dynamics. This study used magnetoencephalography (MEG), a neuroimaging technique with high temporal resolution, to investigate when gestures influence speech. Twenty-three native Japanese speakers took part in a storytelling task under two conditions: Gesture-Required (gesture use instructed) and Gesture-Prohibited (hands kept still). Participants described cartoon clips across multiple sessions (30 trials x 3 sessions per condition). Using speech onset as the reference point, we compared root mean square (RMS) values within a -0.25 to 0 second window. RMS values were higher in the Gesture-Prohibited condition, with increased activity in the bilateral anterior temporal lobes (Left ATL: p = .049; Right ATL: p = .027), but not in motor regions (p = .29). These findings suggest that gestures reduce neural load in language-related regions before articulation. Co-speech gestures may support speech planning by facilitating lexical retrieval or semantic structuring. The lack of motor region effects indicates that this influence is linguistic rather than motoric. This study provides direct direct neurophysiological evidence of the timing of gesture-speech interaction, supporting models that view gestures as an integral part of speech production.

Speech perception often takes place in environments with competing sensory inputs, both within the auditory modality and across modalities; for example, following a conversation in a noisy cafe while simultaneously reading a menu. This study examined the extent to which dividing attention between auditory and visual modalities (bimodal divided attention) influences linguistic context processing across hierarchical levels during continuous speech perception in noise. Electroencephalographic (EEG) responses were recorded while participants listened to audiobook stories in multitalker babble as a secondary task, concurrently performing a demanding primary visual task that imposed either low or high cognitive load. Behaviorally, speech comprehension accuracy was significantly lower under high-load than low-load dual-task conditions. Multivariate temporal response function (mTRF) encoding models were used to predict EEG responses from information-theoretic measures (entropy and surprisal) indexing linguistic context at sublexical, word-form, and sentence levels. Significant neutral tracking was observed at the word-form and sentence levels, but not the sublexical level. Critically, neutral tracking of sentence-level linguistic representations was significantly reduced under high compared to low load, with effects emerging at latencies beyond 200 ms. In contrast, neutral tracking of word-form-level representations was unaffected by dual-task load. mTRF analyses further revealed that neutral tracking of acoustic features was not modulated by dual-task load. These findings indicate that bimodal divided attention selectively disrupts cortical representations of sentence-level linguistic context, while lower-level processing remains relatively preserved. Such impairments in higher-level linguistic processing may contribute to reduced speech comprehension during multitasking in noisy environments.

Mental fatigue is known to impair cognitive and motor performance, but its impact on motor learning remains unclear. This study examined how mental fatigue affects skill acquisition in a sequential finger-tapping task. Twenty-eight participants were assigned to either a mental fatigue group, which completed a thirty-minute Stroop task, or a control group, which watched a documentary of equivalent duration. Both groups then trained on the finger-tapping task across multiple practice blocks with brief rest periods. Overall motor skill improved similarly in both groups. However, mental fatigue altered the pattern of acquisition: participants in the fatigue group showed decreased performance during practice blocks, which was compensated by larger gains during inter-block rest periods. A strong negative correlation was observed between online decrements and offline improvements, indicating that greater declines during practice were associated with larger gains during rest. This study highlights the critical role of rest periods in maintaining learning under cognitively demanding conditions and provides insight into how internal states, such as mental fatigue, can selectively influence the expression of performance without compromising overall learning.